SMALL PERTURBATIONS 
OF A SPIN GLASS SYSTEM 



Louis-Pierre Arguiiil] 



Courant Institute of Mathematical Sciences, New York University, 
251 Mercer St., NY 10012, USA. 



Nicola Kistlei@ 

Institute of Applied Mathematics, University of Bonn, 
Wegelerstr. 6, DE-53115 Bonn, Germany. 



Abstract 

We show through a simple example that perturbations of the Hamiltonian of a 
spin glass which cannot be detected at the level of the free energy can completely 
alter the behavior of the overlap. In particular, perturbations of order 0{logN), 
with N ^ oo the size of the system, suffice to have ultrametricity emerge in the 
thermodynamical limit. 
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1 Introduction 



By virtue of the seminal works of Guerra |15j and Talagrand [20], the hmiting free en- 
ergy of models of Sherrington-Kirkpatrick(SK)-type is now known to be given by the 
Parisi Formula. However, the purported ultrametric organization of the Gibbs states [T7] 
remains poorly understood. 

One piece of evidence for ultrametricity in the SK-type models is obtained through 
the cavity-dynamics framework of Aizenman, Sims and Starr one easily checks that 
the Parisi Formula is obtained when the AS^-functional is evaluated in the Derrida-Ruelle 
Random Overlap Structures (the ROSt's), [IH]. As these are prototypes of ultrametric 
structures, the ultrametricity seems very plausible. This however clearly does not imply 
that the Gibbs measure itself is ultrametric. In [6j it is proved that there do exist models 
whose free energy coincides with that of a hierarchical model but with non-ultrametric 
Gibbs measure (such models were called non-irreducible) . 

Another piece of evidence in favor of ultrametricity stems from the extended Ghirlanda- 
Guerra identities (EGGI), especially in view of Panchenko's beautiful result [16]. There 
are however different problems with the EGGI in relation to ultrametricity. First, it is not 
known whether the EGGI hold for any temperature, but only "on average", cf. [HI [20] . 
Regarding this difficult issue, we have nothing to say. Second, the EGGI are typically 
obtained by adding small perturbations to the Hamiltonian which leave the free energy 
of the system unchanged. The fact that this is a somewhat risky endeavour was already 
clear to Parisi and Talagrand (and presumably to others) who point out in p!8l, p. 3] that 

"...to any Hamiltonian one can add a small perturbation term... such that the per- 
turbed Hamiltonian satisfies the EGGI. The perturbation term is small in the sense that it 
does not change the limiting free energy. (Unfortunately, adding this term might change 
the structure of the overlap)". 

In this note we address the issue of perturbed Hamiltonians with particular emphasis 
on ultrametricity. We consider REM-like systems such as those introduced in [B] which are 
not ultrametric in the thermodynamical limit and show that "small" perturbations to the 
Hamiltonian suffice to have ultrametricity emerge; by this we understand perturbations 
whose variance is of order a log A^, for a large enough and A^ the size of the system. 

The use of small perturbations pervades the whole subject of spin glasses, having 
proved to be crucial in the derivation, e.g., of the Aizenman-Contucci equations [T], of 
the Ghirlanda-Guerra equations [H] and their generalizations EGGI [20]. Usually based 
on sound stability considerations [12], small perturbations must however be taken with 
caution. Indeed, although it is to be expected from general statistical mechanics consid- 
erations that the structure of the Gibbs state can be affected by a small perturbation of 
the Hamiltonian, it is rather surprising that modifications of the order of the logarithm 
of the size of the system suffice to deeply alter the organization of the states0 

^This is to be compared for example to the random field Curie- Weiss model where perturbation of 
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2 General Setting 



Let us start by considering a general Gaussian spin glass system on spins. Precisely, 
we take a centered Gaussian process X = (Xo-)o-g2jv, '■= 1}^) with covariance or 
overlap matrix Q = N{q^„r} and go-o- = 1- At this point, we do not specify a form for the 
overlap matrix Q besides the normalization of the diagonal (and hence no particular geom- 
etry of Sat). In our notation, the SK model corresponds to taking qo-a' = (^j^ J2iLi '^i^'i^ ■ 
Throughout the paper we will write E for the expectation over the process X and P for 
its law. 

The Gibbs measure Q^^n on S^v is defined as usual by 



^^^^^ aes^ 




We write Q^^% for the product measure of s copies of Qp^N- The free energy is denoted by 

We will assume that the limit N ^ oo exists, and that it coincides with the limit of 
E/7v(/3) (self-averaging). 

It is useful for our purpose to make sense of the Gibbs measure in the thermodynamic 
limit N oo (see |1] for details). To this aim, one considers the algebra of observables 
generated by functional of the form 

(1) Sp,N ^ EQ^,% 

for some kij G N. Replicas of configurations are denoted by cij. For each N, the collection 
of observables define the law of a weakly exchangeable overlap matrix Qp^N-, i-e., a random 
matrix whose law is invariant under permutations of rows and columns. 

Weakly exchangeable overlap matrices correspond to Gram matrices constructed by 
independently sampling vectors from a directing measure /i on some canonical Hilbert 
space Ti [13]. In the above example, the directing measure of Qp^N is the Gibbs measure 
Qp^N and the inner product is simply the overlap between configurations. By compactness, 
one can find a subsequence for which the whole collection of observables converge. Each 
limiting measure defines a weakly exchangeable covariance matrix, and hence a limiting 
directing measure, that we refer to as the infinite-volume Gibbs measure and denote it by 
Qp. We stress that this limit will generally not be unique. The whole set of Gibbs measure 
of the system is defined to be the closed convex hull of such limit points. By analogy with 
the finite-volume measure, the pure states at given disorder in this framework correspond 
to the vectors on which a realization of Qp is supported. We gather these considerations 
into a proposition. 

Proposition 2.1. LetQp^N be the overlap matrix constructed by the sampling of the Gibbs 
measure Qp^N- Then each limit point of {Qp^i^)^ defines an infinite-volume Gibbs random 
measure Qp on a canonical Hilbert space Ti. 



order N^^'^ are necessary to modify the measure [3]. 
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We will denote a generic element of 7i by cr and the inner product on Ti by gg-o-' to 
be consistent with the notation of finite systems. We will write d for the distance on Ti 
induced by the inner product 

d{a, cr') = a/1 - qa,a' ■ 

A tantalizing question related to the Gaussian process is to describe the limiting Qp. For 
many systems, the organization of the pure states is expected to obey the appealing Parisi 
Picture. 

Definition 2.2 (Parisi Picture). A spin glass system is said to satisfy the partial Parisi 
Picture if the distance on the support ofQp is ultrametric almost surely, i.e., 

Qp^{d{ai,a2) < max{rf(o-i,o-3),d(o-2,cr3)}) = 1 • 

It is said to satisfy the full Parisi picture if the law of is a Derrida-Ruelle cascade. 

The Derrida-Ruelle cascades will be defined below. A first step towards the Parisi 
picture that can be proven in many examples, and under which the partial picture implies 
the full one, is the celebrated extended Ghirlanda-Guerra identities 

Definition 2.3 (EGGI). A Gibbs measure is said to satisfy the extended Ghirlanda- 
Guerra identities if and only if for a// s G N and for any bounded measurable function 
f : [-1, 1]^' andg: [-1, 1] ^ R 

(2) 

1=2 

We remark that the identities are non- linear in the law of Qf3, because of the product 
appearing on the right-hand side. Therefore the identities cannot hold for convex com- 
bination of Gibbs measures, but only for extreme ones. It is well established that EGGI 
is a necessary condition for the full Parisi picture to hold [TDj. This leads to the natural 
question, is EGGI a sufficient condition for ultrametricity ? A recent and beautiful result 
of Panchenko shows that it actually is, provided the overlaps can only take a finite number 
of values. 

Theorem 2.4 (Panchenko). // a measure Q satisfies EGGI and the number of values 
taken by the non- diagonal entries is finite, then almost surely 

Q®^{d{(Ti,aj) < max{d{ai,ak),d{aj,ak)}^ = 1 . 

Panchenko's theorem thus establishes EGGI as a non-trivial yet simple criteria for a 
spin glass system to satisfy the Parisi picture. A large class of spin glass models, the 
so-called stochastically stable ones, [H [12] satisfy the Ghirlanda-Guerra identities when 
g{q) = q for almost all value of /3. The extended identities are much stronger, since valid 
for all bounded g, and proven in the case of REM- like models [TU|. For more involved 
models, like in the SK-type model, and as p3], one can retrieve EGGI by constructing a 
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perturbed Hamiltonian by adding to the original system independent Gaussian fields 
{X'P) with covariance iV(5Ar{g^^,} for integer p > 1 where 5]^ — >■ 0. The perturbation 
is chosen in such a way that: i) The free energy of the perturbed system is the same 
as the original one: = f] H) The standard procedure to prove the identities can be 
applied for each p. The extended identities then hold for all bounded measurable g{q) by 
approximation. 

The question we address in this paper is motivated by the use of EGGI as a tool to 
investigate the ultrametricity of the limiting Gibbs measure of the original system: 

// X and X^ are two spin glasses with the same free energy, does being 
ultrametric implies so for ? 

In the next section, we provide an example of a simple system for which the answer is 
no, cf. Theorem 13.41 and Corollary 13.51 This in effect also shows that the Gibbs measure 
is not continuous with respect to the perturbation, cf. Corollary 13. 6[ The procedure we 
choose will be different from an expansion in p-powers of the covariance matrix though 
equivalent, and ad hoc to our example. This has the advantage of being valid at all 
temperature as well as providing more insights and better control on the effect of the 
perturbation. The proofs are postponed to Section HI For completeness, the method of 
p-power expansion is outlined in an appendix. 

3 Perturbations of Non-Irreducible Spin Glasses 
3.1 Definition of the Example 

In [6] some nonhierarchical versions of Derrida's GREM were introduced. It was proved 
that the free energy always coincides in the thermodynamical limit with the free energy 
of a suitably constructed GREM. On the other hand it was shown in [7j that not all the 
systems of the form [6] are genuinely ultrametric. Such models were called non-irreducible. 
We are going to consider here the simplest non-irreducible Hamiltonian. 

Let N E N, and consider a = {(Ti,a2) G S^r where 0"i,(T2 G SAr/2. We define the 
Hamiltonian 

(3) x/=^^x(;) + x(^), 

where (xi^^), ai G are iid centered Gaussians of variance Nai and so is (X^J), 

(72 G with variance Na2 and independent of X'^^\ Here Oi, a2 are positive parameters 

such that Oi -|- 02 = 1, and, without loss of generality we assume that Oi > 02. 

By definition, the overlap g^-T between two distinct configurations a and r can only 
take the values 1 if di = ri, (T2 = ^2, o-i if ai = ri, 02 if (J2 = ^2 and if neither projection 
of cr corresponds. The reader can verify easily that the distance induced by the overlaps 
is not an ultrametric. 

The limiting free energy fN^P) = ^i^N ->oo fN^P) of the spin glass ([3]) exists, is self- 
averaging and coincides with that of a two- levels GREM [6J. (Our choice Oi > 02 prevents 
the system from collapsing to a REM.) The Gibbs measure is however clearly a product 
measure and will remain so in the limit, Qpj^{a) = Qj^^j^ ® G^^i with ^^^]^ and ^^^]^ de- 
noting the first and second marginal respectively. Hence, by the structure of the overlaps, 
such a measure cannot exhibit ultrametricity (unless the trivial one). 
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Lemma 3.1. The support of the limiting Gibbs measure Qp of the system ([3]) is not 
ultrametric. In particular, it does not satisfy EGGI. 

Proof. The second assertion can be checked directly. It is also a straightforward applica- 
tion of Panchenko's theorem. □ 



3.2 The perturbed Hamiltonian 

We now introduce a small perturbation of ([3]). For a parameter 5 > which will mea- 
sure the "strength" of the perturbation, we consider an additional family of independent 
centered Gaussians (X^^ with variance Na25 uj{N), where as — cxd, 

uj{N) 0, Nuj{N) ^ oo . 

Assumption 3.2. Nu^N) tends to +oo at least as fast as alog for a > 

(It will turn out that this speed is, as long as the extremal process is concerned, op- 
timal, in the sense that smaller perturbations leave the asymptotical properties of the 
extremal process unchanged, cfr. Remark 14.31 below.) 

We set the perturbed Hamiltonian to be 
(4) X^'=^'x«+X(2)+Xf ^ . 

\ / cr cri ' (72 fTl ,cr2 

We define partition function Zs^n{P), free energy fs^N^P) and Gibbs measure Gf3,s,N in the 
obvious manner. 

The following shows that such a perturbation is indeed small: 

def 

Lemma 3.3. The limit fs{l3) = limTv^oo /5,Ar(/5) exists and is self- averaging. Moreover, 
for any 6 > 0, 

fsiP) = fiP). 

Proof. Denoting by E5 integration with respect to the X^^ ^^-field, it follows by Jensen's 
inequality that 

EfsMP) < log J2 ^^''^P [^^'^ + ^^'i'-^] ] = ^^^^^^ + ya25^(iV). 



N 



Taking the limit N ^ 00 gives the upper bound (in expectation). On the other hand, we 
may rewrite 

EfsMP) = E\oggf,,N(expl3Xi)+EfN{P) 



where the inequality follows again by Jensen. This yields the lower bound (in expectation). 
The self-averaging follows by concentration of measure, see e.g. Theorem 2.2.4 in [20j . 
once it is observed that fs^NiP) has Lipshitz constant smaller than 

/3iV-^/V«i + «2(1 + 0(1)) . 

□ 
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3.3 Gibbs Measure of the Perturbed Hamiltonian 

In order to describe the properties of the Gibbs measure associated to the perturbed 
Hamiltonian, we need to recall some objects, related to the Derrida-Ruelle cascades. 

Consider the point process {C,i,i € N^), with =^ + C,j-^i^, with the following 

properties: 1. {^j^, Zi G N) a Poisson Point Process of density l3ie~^'^^dt, with Pi =^ \f^^'- 

2. For given ii the Point Process (^|^j2,'^2 G N) is Poissonian with density /32e~^^*(it, 

with (32 == sj'^^- 3. For different the point processes and {^l are 

independent. (Remark that, in virtue of our choice oi > 02, it holds /?i < P2 strictly: this 
will become important.) 

We construct a marked point process (mPP for short) on R2 X {0, ai} by setting 

where the overlap qn' of two multi-indices i, i' is defined as if ii 7^ i'^ and ai otherwise. 
Note that by construction the overlaps of X define an ultrametric. 

In the limit 00, it is convenient to look at the shifted energy levels {Xl — a^) for 

^ (1) , ^(2)/;cN 

a-N — ajy + cin [0) 

.(1) AT. l_o ^ 



iVv/ai log2- -^4==log(27raiiV), 
2Vai log 2 

i^'Sib) iVv/a2(l + Mlog2 - -^^1^== log(27riVa2(l + b^)). 

2^/02(1 + 5iv) log 2 



where we write bjq = 600 n for short. 

The following shows that such a small perturbation can turn a non-ultrametric system 
such as ([3]) into an ultrametric one. We formulate the result first for the extremal process. 

Theorem 3.4. Under assumption \3.2[ and for any 6 > the mPP of the shifted energy 
levels 

converges weakly to Xdr. 

To relate this result to the Parisi picture, we need to recall the multiplicative Derrida- 
Ruelle cascades. By these we understand the image of X under the mapping s ^ exp(/5s), 
where P > ^2- This is simply the above marked point process with points replaced by 
rji =^exp(/5^i), that is 

We observe that P > P2 insures that ^ r/j < 00 almost surely. By Z we understand the 
normalized Derrida-Ruelle multiplicative cascades, namely the above Point Process where 
the points r]i are replaced by their normalized counterparts fj^ =^ rji/ rjj. 

The normalized cascade is nicely expressed in terms the Bolthausen-Sznitman coales- 
cent, introduced in [8j. This is a continuous time Markov process [tpt, t > 0) taking values 
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in the compact set of partitions on N. We call a partition C finer than in notation 
C >~ V, provided that the sets of V are unions of the sets of C. The process {ipt^t > 0) has 
the following properties: i. If t > s then ipg >- ipf. ii. The law of {ipt, t > 0) is invariant 
under permutations involving only a finite number of elements, in. tpo = {{l}? {2}, •••}• 
We denote the equivalence relation associated with tpt by ~i. To every pair of point 
corresponds a stopping time t{i,j) := min{Z : i r^t j}- 

For xi := / = 1,2, we pick to = < ti < t2 < oo with U = \og{x2/x2-i)- The 

overlap qij is defined to be if t{i,j) > t2, ai if t2 > t{i,j) > ti and 1 otherwise. Given a 
Poisson Point Process {zi^i G N), one can construct a marked point process [7] 

where the marks qu' are chosen randomly as above, independently of the point process 
{zi,i e N). The law of such an object is denoted by P □ C, where P is the law of the 
underlying point process, and C that of the coalescent. A normalized cascade can be 
shown to have the law H C where P^ is the law of the normalization of the Poisson 
point process with density xt~^~^dt on R_|_ [8]. 

Corollary 3.5 (Full Parisi Picture). Let f3 > (32- Then the marked point process of the 
Gibbs measure associated to the perturbed Hamiltonian 

^ ^ '^5/3,a,jv(o"),0/3,5,]v(T"),g(o-,T) 

converges weakly towards Px2 n C, where Px^ is the law of the normalization of the poisson 
point process with density X2t~^'^~^dt on ]R_|_. 

A direct consequence of the above is that the EGGI hold for the perturbed Hamilto- 
nian, thereby proving the discontinuity of the Gibbs state under the perturbation. 

Corollary 3.6 (Perturbed Hamiltonian and EGGI). The limiting Gibbs measure of the 
perturbed system Qp^s satisfies EGGL In particular, in the sense of the topology induced 
by the functions 

lim g^^s ^ Qfi 

(5^0 

where is the limiting Gibbs measure of the original system ([3]). 

Proof. By Corollary 13. 5[ lim^^o G/3,s is a Derrida-Ruelle cascade. They are well-known 
to satisfy EGGI, cfr. Bovier and Kurkova's work [TT]. By Lemma 13.11 Qj3 does not. 
The conclusion follows from the fact that the identities are continuous in the topology 
determined by the observables ([1]). □ 

4 Proofs 

The proofs of Theorem 13.41 and of Corollary 13.51 very closely follow the line of proof of 
the Main Theorem in [7j. To keep this work reasonably self-contained we shall however 
outline the crucial steps, especially those steps which differ from the analysis in [7]. (It 
turns out that these differences are only very small.) 
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Throughout, K will denote a constant, not necessarily the same at different occur- 
rences. We shorten the notation for the shifted processes X^^ =^ X^^ — X^^ =^ 

— aj^-* [6) and X^ =^ X^^ + X^^ + X^_^ . We will need the following straightforward 
asymptotics 



I'M 



Pi + 



(5) 



aiN 
a2Nil + 5n) 



exp 



exp 



logA^ 

(32{1 + 0{5n)), 
202(1 + (5jv) AT 



I'M 



2aiN 



2-^/2^iy2WV(l + o(l)). 



2-^^^ P2V '2^(^2(1 + Sn) Nil + 0(1)). 



Lemma 4.1. Let M be a compact set. For given e > there exists large enough compact 
M such that 



F 3ae J^N, such thatXi e M, hutXl^ ^ M orX'^^ + ^ M 

for large enough N . 

Proof. We first claim that to £ > there exists C > such that 



< e 



(6) 



P 



3cri G aN/2 ■ Xl^ > C 



< e. 



This is straightforward: the left side of the above expression is bounded by 



Xl >C 



< Ke 



-liiC 



where the second inequality follows from the asymptotics ([5]). It thus suffices to choose 
C large enough in the positive. 



We now claim that to e > there exists i? > such that 



(7) 



P 



3a e such that X^ G M, but X^^^ ^ [-R, R] 



< e. 



By ([6]) we can find R large enough in the positive such that 



P 



3 di : X(i) > R 



< e/2. 



On the other hand, 



P 



3a e Sa, : e M,Xi]^ < -R 



< 2^P 



e M, X,,, < -R 



(9) 



< 2^ E 



exp 



2a2N{l + 6N) 



dy 



• X^ ^ R 
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Omitting the positive terms in the expansion of the quadratic polynomial we have 

2- 



(10) 



exp 



2a2N{l + 5 



N 



< 



exp 



2a2il + Sn)N 2a2N{l + 6_ 



N 



which, by the asymptotics is 

(11) < ir2-^/V27ra2iV(l + ^a^) exp[-p2y] ■ 

We thus obtain 



(12) 



exp (^2X1 ];Xl< -R 



'^'^ydy. 



M 



It is straightforward to see that E exp ( ^2^^^^ ) ; < —R 
bining, we have 



< ir2-^/2e-('32-^i)^. Com- 



P 



3aeE^: Xte M, X^^) < -i?] < exp (-(/^a - A)i?) , 



and since P2 — Pi > 0, it suffices to choose R large enough in the positive to make the 
above smaller than e/2: this then yields ([7]) with R := max(i?, R). 



Now, e M and xi^^ G [-R,R\ implies that X^t' + X^^^^ G M - \-R,R\. The 
claim of the Lemma thus follows with M chosen large enough to contain both [— -R, R\ 
and M- □ 

The following Lemma provides the crucial piece of information pertaining the ultra- 
metricity of the perturbed system. We emphasize that the statement is wrong if 5 = 0, 
that is when the Hamiltonian is simply X^, = X^^ + X^^ : in that case, coincidence of two 
configurations on the second spin does not imply also equality on the first. 



(2) 



Lemma 4.2. Let M be a compact set and e > 0. Then 

P 3 (T, r G Sat : (Ti ^ n, aa = Ts such thatX^, G M 
for large enough N . 

Proof. By Lemma 14.11 we can find compact M such that 



P 



3a G S^, such that X^ G M, but X^^ ^ M or X^f + X^^_^^ ^ M 



< 



Thus, 



(13) 



e 

^2 + 



3a,r G S^,ai n, ^2 = T2 : X^X^ G M 

U [XI^,X\ G M and X^ + Xf^,,^, X^^ + X^^,,^ G M 



X^^ G M 



P 



X^^ + X^^,,^GM,X^,+X:?^,,^GM 



since for ai 7^ ti the random variables X^^,X^^ and X^^,X^^ are independent. 
Now it is easily checked that 



P 



xi gm 



< K2 



-N 



To prove the assertion we thus need to check that the second probability is of order 
2-^/2o(l). We set 

Aag) :=ag)(5)-a(J)(0) 
where we omit the dependence in 6 for simplicity. And by expanding, 



Aa 



(2) 
N 



, VQ2log2 
-NOn I : h 0(1 



We will need the asymptotics 



Aa 



(2) 
N 



Aa 



(2Y 



a2N5N 

Therefore, for any x G 



N 



NS 



N 



log 2 



+ 0(1: 



P 



+ X' E M ~ X 



exp 



M-x 



2Tcar,N5 



N 



dy 



N 



< K- 



K- 



J M-x 



exp [- (/?2/2 + o(l))y] dy 



VN6n 

where the last equality comes from a change of variable. 
The second probability in (IT^ is for (Xi 7^ ri 



exp[(/52/2 + o(l))x] 



P 



X^ +X^„, GM,X2 +X,^, 



G M 



(14) 



P 



exp 



{x + a^^\0)) 



dx 



V27ra2X 



The estimate (jlj) together with the asymptotics for a\j (0) yields the upper bound 



K 



N5n 
< 2-^/2^ 



exp 



{(32 + o{l))x - 



2a2N 



dx 



V2vra2X 



exp [o(l)x] 



V2vra2X 



2-^/2irexp 



X5 



log 2 , log(X5^)^^^^^ 



N6 



N 



where the last equality follows by integration. It remains to prove that the exponential 
term tends to 0. But this is so if N6]\f is at least of order a logX for a > since 



log(X5 



N) 



NS 



logX^21og(X5^) 



N 



NS 



N 



NS 



N 



logX 
' NS 



+ 0(1) 



N 



□ 
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Remark 4.3. We stress that the above result essentially stands due to the fact that the 
perturbation introduces a square in the probability fll4p . It is quite remarkable that, even 
for such small perturbations, this alone is enough to make the probability of the event 
negligible. On the other hand, as long as the extremal process is concerned, we believe 
that our Assumption \3.2\ on the size of the perturbation is fairly optimal, in the sense that 
smaller perturbations (o{logN), for N oo) will presumably force the probability of such 
an event to stay macroscopic. 

Sketch of the Proof of Theorem 13.41 The content of Lemma 14.21 is that one 
cannot find two configurations a, r with shifted energy levels falling into a prescribed 
subset for which the overlap q{a, r) = if coincidence on the second spin, then also 
automatically on the first, whence the two configurations must coincide. But this entails 
that the configurations falling into prescribed subsets have the same kind of dependencies 
(= hierarchical) as if they were coming from a two- levels GREM, and it is therefore not 
surprising that the mPP of the 5-perturbed Hamiltonian converges weakly to the one 
constructed outgoing from a GREM: it is explained in ^ how this simple observation, 
together with the asymptotics used above, e.g. 



P 



Xi G Mi,Xi^i G Maj = 2-^(1 + o(l)) / e-^^'^dy [ e-f^^^dy, 



which holds for any compacts Mi,M2 C M, allows to prove that the mPP Xf^ converges 
weakly to X . We will not reproduce the proof here: it is a natural modification of what 
is known as the Chen-Stein method [S] to prove Poisson Approximation. 

Sketch of the proof of Corollary 13.51 This is rather straightforward. One first 
proves convergence of of the "image" of the process A'at under the mapping s ^— > exp(/?s). 
This is very standard: the upshot is that 

= X^^cxp/3X^, exp/3X^, g(o-,r) 

converges weakly towards y. 

Having proved this, it suffices to prove that the normalization 

n y5 exp 

exp fJXr 

commutes with the limit — > 00 to obtain that 

57 def . dcf exp PX^ 

- Z^%^x^,exp/3X^,g{a,r)' ^Xp pA, - ^ pj^S 

(this is nothing but Qp^s^Nio')) converges to Z. Again, this is very standard, and we refer 
the reader to [H pp. 34-35] for the proof that the two operations commute. 

The Corollary 13.51 then follows by the remarkable properties of the Derrida-Ruelle 
cascades and the coalescent. We refer the reader to [9[ Section 9.2, pp. 93-94] for the 
heuristics, which in particular clarifies how the special form of the intensity of the Point 
Processes t h-^ exp(— /3jt), i = 1, 2, plays a crucial role. 

□ 
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A EGGI for General Perturbed Systems 



In this section, we outline the method of perturbation by expansion in p-powers. This 
is done in such a way to leave the free energy unchanged and retrieve the extended 
Ghirlanda-Guerra identities for almost all values of the parameters. We follow closely the 
treatment of the p-spin model in [20]. The interest of such a method is that, coupled 
to Panchenko's theorem, it provides a way to prove the Parisi picture for the perturbed 
Gibbs measure of a fairly wide class of Hamiltonians (see Proposition lA. II below) . 

Let X = (Xa-)o-Gi;iv be a spin glass Hamiltonian with covariance N{q„„'} as in the 
general setting of Section 2. Consider {Pp)p>i with Pp > and ^p>i Pp < oo. We write /3 
for a vector {Pi, P2, Ps, ■■■)■ It is convenient to assume that for all p: Pp < Pi- We say that 
a property holds for almost all in P for the measure given by the product of the Lebesgue 
measures on [0,/?i]. The perturbed Hamiltonian is 

(15) /3iX. + V^^/3pXP 

p>i 

where (X^) are centered Gaussians with covariance N{q^^,} independent for distinct p 

1 /8 

and X. We shall need that 6^ ^ and N6j^ — > 00. Therefore N6n must grow faster 
than A^^/*, a condition much stronger than log A^. The application of Panchenko's theorem 
proven here is: 

Proposition A.l (Full Parisi Picture). Suppose that the number of values taken by the 
overlaps {qaa'} is uniformly bounded in N. Then for almost all P, the limit points of 
{Qpj^)N (ii^G Derrida-Ruelle cascades. 

By Panchenko's theorem, the proof reduces to show EGGI. 

Lemma A. 2. For almost all P, the limit points of {Qp jq)N satisfy EGGI. 

The first ingredient is the self-averaging of the internal energy in /3-average coming 
from convexity and concentration of measure. 

Theorem A. 3 (Theorem 2.12.1 in [20j). In the setting of (fTSl) . one has for every p > 1 



-^[0,/3if 



dp < 



for some constant K independent of N and p. For p = 1, the above holds without 6 



N- 



We denote by a generic limit point of (^^^y). We write /s(g) for any bounded 
measurable function of the overlaps of s copies. The above theorem is applied directly 
to prove the factorization essential to the proof of the EGGI. Namely, if ^ as 

N 00, then for every p and almost all P 



'X^ fsiq)' 

On the other hand, standard Gaussian integration by parts yields for every A^ 



. 1=1 
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By combining the two last equations, one gets an approximation of any bounded 
measurable function g by approximating with polynomials, thereby retrieving EGGI and 
proving the proposition. 

□ 

Acknowledgments. The idea of small perturbations of non- irreducible models 
was mentioned by Erwin Bolthausen (apparently after a discussion with Silvio Franz) to 
the second named author long ago. We thank Bolthausen and Franz for sharing their 
insights. 
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